A Generic Parallel Collection Framework

نویسندگان

  • Aleksandar Prokopec
  • Phil Bagwell
  • Tiark Rompf
  • Martin Odersky
چکیده

Most applications manipulate structured data. Modern languages and platforms provide collection frameworks with basic data structures like lists, hashtables and trees. These data structures come with a range of predefined operations which include sorting, filtering or finding elements. Such bulk operations usually traverse the entire collection and process the elements sequentially. Their implementation often relies on iterators, which are not applicable to parallel operations due to their sequential nature. We present an approach to parallelizing collection operations in a generic way, which can be used to factor out common parallel operations in collection libraries. Our framework is easy to use and straightforward to extend to new collections. We show how to implement concrete parallel collections such as parallel arrays and parallel hash maps, proposing an efficient solution to parallel hash map construction. Finally, we give benchmarks showing the performance of parallel collection operations.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On A Generic Parallel Collection Framework

As the number of cores increases in modern multiprocessors, it is becoming increasingly di cult to write general purpose applications that e ciently utilize this computing power. This remains an open research problem. Most applications manipulate structured data. Modern languages and platforms provide collection frameworks with basic data structures like lists, hashtables and trees. These data ...

متن کامل

ClassifyR: an R package for performance assessment of classification with applications to transcriptomics

UNLABELLED Although a large collection of classification software packages exist in R, a new generic framework for linking custom classification functions with classification performance measures is needed. A generic classification framework has been designed and implemented as an R package in an object oriented style. Its design places emphasis on parallel processing, reproducibility and exten...

متن کامل

Formal Derivation of Two Parallel Rendering Algorithms

This paper presents the formal deriva tions of two parallel rendering algorithms from a high level speci cation The initial speci cation of the problem is formulated as a functional program A calculational approach is used to derive from the original speci cation two parallel algorithms expressed as networks of communicating processes in Hoare s CSP Both algorithms exploit pipelined parallelism...

متن کامل

Generic Parallel Algorithms

We develop a nature-inspired generic programming language for parallel algorithms, one that works for all data structures and control structures. We show that any parallel algorithm satisfying intuitively-appealing postulates can be modeled by a collection of cells, each of which is an abstract state machine, augmented with the ability to spawn new cells. The cells all run the same algorithm an...

متن کامل

Botnet Detection Framework

Botnet ia a collection on network of bots. i.e the collection of zombie computers which are controlled by a single person or group known as bot master or herder. This paper focuses on botnet detection framework and proposed a generic framework for botnet detection. The proposed framework is based on the approach of passively monitoring network traffic. This paer also show the flow chart of Gene...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011